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a{ip,(f>)<a and ^{ip)<^, 
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^ ■ where a £ [0, 1] and ^ > 1 are some restrictions. It is supposed that ^{ip) is 



calculated under some fixed (not necessarily coinciding with one of Pq) distribution 
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1 Introduction 



Let Xi, X2, . . . , Xn, ... be a discrete-time stocliastic process witli a distribu- 
tion Pq, 9 G O, where G is an open subset of the real line. We consider the 
problem of testing a simple hypothesis Hq : 9 = 9o versus a composite alter- 
native Hi : 9 > 9o, where 9o & Q is some fixed point. The main goal of this 
article is to characterize the structure of locally most powerful, in the sense of 
Berki ( 119751 ). sequential tests in this problem. 



We follow iNovikovl (l2009bl ) in the definitions and notation related to sequential 



Wald 


fl950h. 


Fereusonl fl967h. 


DeGroot 


(1970f). 


Schmitz ( 


1993 


), 


Ghosh et al. 



( I1997I ). among many others). 

In particular, we say that a pair {ip, (p) is a sequential hypothesis test if 

^= (^l,^2,...,V'n, •••) and 0= (01,02,. ••,0n,...), 

where the functions 



Ipn = 'ipn{Xi,X2, . . . ,Xn) and (pn = 4>n{xi, X2, ■ ■ ■ , Xn) 

are supposed to be measurable functions with values in [0, 1], = 1, 2, . . . . 

For any stage n = 1,2,..., the value of ipni^i, . . . , x„) is interpreted as the 
conditional probability to stop and proceed to decision making, given that the 
experiment came to stage n and that the observations of the process up to 
this stage were {xi, X2, ■ ■ ■ , a;„). The rules ipi, ip2, ■ ■ ■ are successively applied 
until the experiment eventually stops. 

It is supposed that when the experiment stops, at some stage n > 1, the 
decision rule 0„ will be applied to make a decision. The value of 0„(a;i, . . . , x„) 
is interpreted as the conditional probability to reject the null-hypothesis Hq, 
given that the data observed up to this stage, were (xi, . . . , Xn)- 

The stopping rule ip generates, by the above process, a random variable 
{stopping time) whose distribution is given by 

Pe{T^ =n)= Ee{l - ^i)(l - ^-2) ... (1 - ^n-i)^n. (1.1) 



Here, and throughout the paper, Eq^-) stands for the expectation with respect 
to the distribution Pg of the process Xi, X2, .... 

In (11.11) . we suppose that ipn = 4'n{Xi,X2, . . . ,X„), unlike its previous defi- 
nition as ipn = 'ipnixi, X2, ■ ■ ■ , Xn). We do this intentionally and systematically 
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throughout the paper, applying, generally, for any F„ = Fn{xi, X2, ■ ■ ■ , x„) or 
Fn = Fn{Xi, X2, . . . , Xn), the following rule: if F„ is under the probability or 
expectation sign, then it is F„(Xi, . . . , otherwise it is . . . , 

To characterize the duration of the sequential experiment, the average sample 
number is used: 



En=inP{T^ = n), if P(r^ < 00) = 1, 
00, otherwise. 



:i.2) 



For a sequential test {ip, 0) let us define its power function at 6 as 



0) = Pe(reject Ho) = ^ - V^i) • • • (1 - ^n-i)i^n 

n=l 

The type I error probability of the test {ip, cp) is defined as 



:i.3) 



a{ip,(p) = /3eo(^,0)- 



Our main goal is characterizing tests which maximize the derivative of the 
power function at 6* = Oq, PgQ{ip,(p), among all sequential tests {ip,(p) such 
that 



and 



a{ip, (p) < a, 



:i.4) 



:i.5) 



where a G [0, 1) and ^ > 1 are some res trictions. In c ase this test e xist, it is 
called the locally most powerful test (see iBerkI (119751 ) . iRotersI (119921 )). 



There is a natural candidate for the distribu tio n under which y f'f?/;) = Et^ is 
calculated in (II. 5p : it is Pg^^ (see iBerkI ( 1l975l ) or lSchmitzl (119931 )). Nevertheless, 
we pose a more general problem in this article, supposing that Er^ is calcu- 
lated under an arbitrary (but fixed) distribution of the process. In particular, 
it may be useful to employ as P a "mixed" distribution defined as 



P(-) = I Pe{-)d7i{e), 
10 



where vr is some probability measure (see Section 4.2 in iNovikovl (j2009bl ) for 
a good reason for doing so). 
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2 Assumptions and Notation 



We suppose throughout the paper that, under Pg, for all 6* G 9, the vector 
(Xi, X2, . . . , X„) has a probabihty "density" function 

fe ~ fe (^1) ^2, • • • 5 Xn) 

(Radon-Nikodym derivative of its distribution) with respect to a product- 
measure 

/i*^ = ® /i CS) ■ ■ ■ ® /i, 
n times 

with some a-finite measure fi on the respective space. 

We will also suppose that the distribution P of the process used for calculating 
f ll.2p is some arbitrary (but fixed) distribution such that (Xi, . . . ,X„) has a 
"density" /"(xi, . . . , Xn) with respect to /x", n = 1, 2, ... . 

The following assumption is basic for the differentiability of power functions, 
a sort of which is obviously needed in view of the problem formulation in the 
Introduction. 

Assumption l.For any n > 1 there exists a measurable integrable function 
Jq such that 

l\fl+h~feo-hf^\di^- = o{h), 

as h ^ holds. 

Assumption 1 is nothing more than the Z/i(/i'^)-differentiability of the joint 
density function fg, with respect to 6, at 6 = 6q, for any n = 1,2, . . . . 

In particular, it follows from Assumption 1 that for any measurable function 

4>n = 4>n{Xl, . . .,Xn), < 0.„ < 1, 

' <Pn {fl+, - fl - hf^) rf/i" = 0{h), (2.1) 

as 0. In fact, it is easy to see that (12.11) is equivalent to Assumption 1. 

(12. ip means that the power function /5e(n, (p) of any fixed sample-size test based 
on the first n observation, is differentiable at 6' = 6'o, and that its derivative is 



(See Conditions CI to C3 in lNovikovl fl2006 h and similar c onditions, for inde 



pende nt and identically distributed (i.i.d.) observations, in iMiiller-Funk et al. 



(119851 ) in relation to differentiability of power functions.) 
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It is easy to see that if the partial derivative of with respect to 6 exists 
/i'^-almost everywhere at 6 = 6q, then it follows from (12. ip that 



rr 

Jo 



09 



(2.2) 



/i'^-almost everywhere. In fact, this assumption is used in iBerkI ( 1l975l ) along 
with the condition of differentiabi lity o f powe r function of fixed sample size- 
tests (see Assumptions 2 and 3 in iBerkI (119751 )). in the i.i.d. case. 



The following assumption is needed to treat the optimality in the general case 
of non-truncated tests below. 

Assumption 2. The power function of any test {ip,(p) such that Eg^r^p < oo, 
is differentiahle at 6 = 6q, and 



oo ~ 

M, 0) = E / (1 - ^l) • • • (1 - ^n-l)^n0 Jo" dfi' 
n=l 



(2.3) 



If the partial derivative (12. 2p exists, (12.30 may be deemed as differentiating 
across the integral sign, because of (11.31) . 



For i.i.d. observations, there are various conditions which guaran tee th e differ - 
ent lability as in Assum ption 2 (see, for exam pl e. Proposit ion 1 in iBerkI (119751 ) . 
or related properties in Miiller-Funk ( 1986 ) or Irle ( 19901 )). 



We will also need the following 



Assumption 3. There exist 7 > and Nq > such that 



Eeo ( ^ 

\Jeo/ 



< 



777, 



(2.4) 



for all n > Nq. 



The expectation on the left-hand side of (12. 4p is the Fi sher i n forma tion con- 
tained in (Xi, . . . ,X„). In the i.i.d. case considered i n iBerkI (119751) . (12. 4p is 
obviously an immediate consequence of Assumption 4 iBerkI (119751 ) . 



To avoid cumbersome notation, we shall further on write Eq, f^, /3o, and (3q 
instead of Eg^, Pg^, and /jgp, respectively. 
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3 Reduction to an optimal stopping problem 



To proceed with maximizing Poi^ip, 0) over the tests subject to (11.41) and (11.51) 
let us define the following Lagrange-multiplier function: 

L{^, 0) = L{ij, 0; 6, c) = c^(^) + ba{^, 0) - $o{^, 0) (3.1) 

where c > and 6 G M are some constant multipliers. 

The following theorem is a direct application of the Lagrange multiplier method 
to the conditional problem above. 

Theorem 3.1 Let A be some class of sequential tests. Let there exist c > 
and b > and a test (-0, 0) G A with L{ip, cj); b, c) > — oo, such that 

L(V;,0;6,c)= inf L{^' , cP';b, c) (3.2) 

and such that 

jr{ip) = ,jr and a{ip,(p) = a. (3.3) 
Then for any test (0', 0') G A satisfying 

^{ip')<^ and a(0',0')<a (3.4) 

it holds 

/3o(^,0)>/3o(V^',0')- (3.5) 

The inequality in 5\) is strict if at least one of the inequalities in ([J.^|) is 



strict. 

Proof. It is quite straightforward: 

Let ("0', 0') G A be any test satisfying (13.41) . Because of (13.31) and (13. 2p . 

cJ^ + ba- /3o(0, 0) = c^(^) + ba{^, 0) - po{^, 0) 
< c^iij') + baiij', 0') - poii^', 0') <c^ + ba- $o{tP', 0') (3.6) 

where to get the last inequality we used (13.41) . 
It follows from (13. 6p that 

To get the last statement of the theorem we note that if Poi^ip, 0) = Poii^', 0') 
then there are equalities in (13.61) instead of the inequalities which is only 
possible if ^{ip') = JV and a{ip',4>') = ct- ■ 
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Remar k 3.1 There i s a mo r e rest ri cted defi n ition of locally most powerful 
tests in ISerk (197 A) . Roten (199^) . Schmitz (199^) (among others), where 
the derivative of the power function is maximized within the class of all tests 
with a given value of the type I error probability (a{ip' , (f)') = a instead of 
a{il)\(j)') < a in Ili3.4\ ))- It is obvious that, with this modification, the assertion 
of Theorem \3.1\ is also valid if the conditions of Theorem \3.1\ hold with b < 0. 



If the conditions of Theorem \3.1\ hold with 6 = 0, then for any test [tp', (f)') G A 
satisfying 

^{tP') < jV (3.7) 

it holds 

/3o(^,0)>/3o(^',0')- (3.8) 



The inequality in h3. gj) is strict if the inequality in lj^3. 7| j is strict. 
For any stopping rule ip = {ipi, 'ip2, ■ ■ ■) ^^t us denote 

St = il-^l)...il-^n-l)i^n and tt = il-tpl)...{l-^n-l), 

for any n = 1, 2, . . . (tf = 1 by definition). 

Let Ia be the indicator function of the event A. 



T he followi n g theo rem, in a rather standard way (see, for example, iBerkI (119751 ) 



or 



Schmitzl (il993f )). lets us find optimal decision rules for any given stopping 



rule xp. 

Theorem 3.2 Let Assumption 1 be fulfilled. For any 6 G M and for any se- 
quential test {ip, 0) such that EqT^ < oo 



6a(0, ^P) - /?o(0, V^) > E / 4 min{0, bf^ - f^jdfi^ 



n=l 



(3.9) 



with an equality if and only if 



(3.10) 



jjL^-almost everywhere on S"^ = |(xi, ... , x„) : sj(^(xi, . . . , x„) > o| for any n 
1,2 



The proof of Theorem 13.21 can be found in Appendix. 
Let us denote 

L^ip) = L(ip] b, c) = inf L{ip, 0; b, c). 



7 



Corollary 3.1 Under conditions of Theorenn \3.^ if Eqt^ < oo, then 

oo „ 

W) = E sticnf^ + Qdfi'', (3.11) 

n=l 

where, by definition, 

ln = mm{Q,bfo-fo}- 
Proof. This follows from Theorem 13.21 by (13.11) , in view of (11.21) . ■ 

By Theorem 13.21 the problem of minimization of L{iIj, 0; b, c) is reduced now 
to the problem of minimization of L{tp;b,c), that is, to an optimal stopping 
problem. Indeed, if there is a ip such that Eqt^ < oo and such that 

L{il)]b,c) = miL{ilj';b,c), 

then, adding to any decision rule satisfying (I3.10p . by Theorem 13.21 we 
have that for any sequential test (■?/'', 0')- 

Lii:, 0; b, c) = L{tp- b, c) < L{ij'- b, c) < L{ij', 0'; b, c). 

In particular, in this way we obtain tests (-0, 0) satisfying (13. 2p . which is crucial 
for solving the original conditional problem (see Theorem 13. ip . 

4 Optimal Stopping Rules 

In this section, we characterize the structure of stopping rules minimizing 
L{i/j), first in the class of truncated stopping rules, then in some natural classes 
of non-truncated stopping rules. 

We suppose, throughout this Section, that Assumption 1 is fulfilled. 

4-1 Optimal Truncated Stopping Rules 

Here we solve the problem of minimization of L{iIj) in the class of truncated 
stopping rules, that is, in the class , N > 1, of stopping rules ip such that 

(l-^l)(l-V'2)...(l-^7v) =0. (4.1) 
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For any stopping rule ip G ^ let 

N-l 

L^{^) = L^i^; b,c)=J2 J 4icnr + Qdfi^ + j t% (cN f + 1^) dfi"" 

n=l 

(4.2) 

(it is easy to see that, by virtue of (14. ip . Ln{iP) coincides with the right-hand 
side of fIXTTD l 

Let us define = Ijq, and recursively for any n = A^ — 1,A^ — 2,...l 

\/^ = min{/„,cr + 0, (4.3) 

where 

Rn = Rni^U-'-^^n) = J K+ll^^b • • • ) Xn+l)dn{Xn+l) ■ 

Let, finally, for any k = 1, . . . , N 

QkW = E / sticnr + Qdfi'' + Jtt {ckf + Vf ) dfi' 

n=l 

Theorem 4.1 Let ip G he any (truncated) stopping rule. Then for any 
l<k<N 

LnW > QkW (4.4) 
The lower bound in lji4-4\ ) attained if and only if 

h^r^<cr+RS} < < hln<cf"+R^} (4-5) 

^"^ -almost everywhere on 

T^ = {{x,,...,Xn):tt{xu...,Xn)>0} 
for any n = k,k + l,...,N — 1. 
The proof of Theorem 14.11 is laid down in Appendix. 
From Theorem 14.11 we easily have the following optimality result. 
Corollary 4.1 For any if) G 

LnW>c + R^, (4.6) 

where 

Ro = J Vf{xi)dfi{xi). 

There is an equality in (^7^ if and only if ipn satisfy lji4-5\ ) fi'^ -almost every- 
where on T^ , for any n = 1,2, . . . , N — 1. 
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Proof. It is straightforward because 



4-2 Optimal Non- Truncated Stopping Rules 

In this section we characterize the structure of general sequential tests mini- 
mizing L{ip) = L{ip;b,c) (see fl3.1l) ). 

Let us define for any stopping rule ip, and for any natural > 1, 

LnH^) = LnH^; b, c) = b, c), 

where = ("^i? 4'2, ■ ■ ■ , i^N-i, 1, • • • ) is the rule ip truncated at A^. 
By 

LnW = E y 4icnr + Qd^i^ + Jt% (ciV/^ + rf/x^. 



n=l 



Because is truncated, the results of the preceding section apply, in par- 
ticular. Theorem 14.11 The idea of the following construction is to pass to the 
limit, as — > oo, in (14.41) . in order to get some lower bound for the "risk" 
L{ip), and corresponding conditions under which the lower bound is attained. 

First of all, let us show that the right-hand side of (14.41) has a limit, as N oo, 
for any = 1, 2, . . . . This is basically due to the following 

Lemma 4.1 For any n > 1 and for any N > n 

In > > (4.7) 

The first inequality in (14.70 is due to (14.31). T he proof of the second is identical 



to the proof of Lemma 3.3 INovikovl (j2009bl ). 



It follows from Lemma 14.11 that for any fixed n > 1 the sequence , N ■ 
1,2,..., is non- increasing. So, there exists 

K = hm Vf (4.^ 
such that Vn < In for all n = 1, 2, . . . . 
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Because of this, the right-hand side of fl4.4p . by the Lebesgue's monotone 
convergence theorem converges to 

k—l 

QkW = E / ^ticnr + ^n)rf/i" + Jtt {ckf + Vk) dfi' (4.9) 

n=l 

for any k = 1,2,.... By the same reason, passing to the hmit on both sides 
of (14.31) is possible, which gives us 

Vn = mm{ln, cP + Rn}, 

where 

Rn = Rn{Xl, ...,Xn)=J Vn+l{Xl, . . • , X„+i)(i/i(x„+i) , 

for any n = 1,2, ... . 

At last, to be able to pass to the limit on the left-hand side of (14. 4p . we need 
that L^ii') — >■ L{ip), as — s> oo, at least for some class of stopping rules ip- 
Let ^ be a class of stopping rules such that for every ip & ^ it holds 

EqT^ < oo, Et^ < oo, and lim L]^{ip;b,c) = L{ip;b,c) (4-10) 

for all 6 G M and c > (the first condition in (l4.1Up is needed in order that 
(13. lip be valid, the second one guarantees that L{ip; b, c) < oo). 

Now passing to the limit on both sides of (14.40 . as — oo, is possible for all 

ip G so we get 

Lemma 4.2 For any stopping rule ip & ^ and for any k > 1 

where Qki'ip) is defined by lji4-^ > being Vn defined, for any n = 1,2,..., by 

In particular, for any stopping rule ifj & ^ 

L{^)>c + Ro. (4.11) 



The following lemma shows that the lower bound in (14. lip is, in fact, the 
infimum value of the left-hand side of (14.111) . 

Lemma 4.3 Let G ^ be any subclass of stopping rules, such that 

oo 

U C ^. (4.12) 

Af=l 
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Then 



inf L{ip) = c + Ro 



Proof. If Rq > — 00, then t he proo f is conducted in the same way as the proof 
of Lemma 3.5 in iNovikovl (l2009bl ). 



If Rq = —00, it follows from limTv^oo Rq = Ro that for any k > —00 there 
is such that Rq < k. Thus, because of (14.121) . ini^^c^ L{ip) < k. Because 
A; > —00 is arbitrary, inf^g^ L{iIj) = —00 follows. ■ 

Theorem 4.2 Let Assumption 2 be fulfilled and let ^ he any class of stopping 
rules satisfying the conditions of Lemma \4.3\ and such that 



inf L(ih') > -00. 



(4.13) 



// there exists if) in^ such that 



L{^1^)= inf L(^'), 



then 



(4.14) 



fi"'-almost everywhere on , for any n = 1,2,..., and 

J ^ti^n - Qdif ^0, as 00. 



(4.15) 



(4.16) 



On the other hand, if ip satisfies ( [^ . i 5| ) -almost everywhere on , for any 
n = 1,2, . . . , and satisfies \4.16\) , and ifip&'i^, then it satisfies (JjJ^ ^■^ well. 

The proof of Theorem 14.21 can be found in Appendix. 

Remark 4.1 Generally speaking, I!i4-i3\ ) can be violated. Let us see the fol- 
lowing example, in which 

inf L{ilj;b,c) = -00 

for allb eR and c> 0. 

Suppose that Xi,X2, . . . are independent and that X„ is normally distributed 
with mean nO and unit variance (Xn ~ jV{n9, 1)), n = 1,2 . . . . Suppose also 
that Ho: 9 = and Hi -.6 >0. 
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Let if)^ he a fixed sample size-stopping rule taking N observations (ipf = . . . = 
ipN-i — O5 "^iv = N = 1,2, . . . . Then it is easy to see that 



where aj^ = Y.n=i^'^ ~ ^^/3, thus, L{-ip^;b,c) —00 as N ^ 00, for any 
6 G M and c> 0. 

With respect to the property of (14.131) . any hypothesis testing problem exhibits 
the following remarkable behavior. 

Theorem 4.3 For any family {fj}, G O, n = 1, 2, . . . } of the finite- dimensional 
distributions of the process Xi,X2, . . . , satisfying Assumption 2, either 



for allb eR and c> 

The proof of Theorem 14.31 is laid down in Appendix. 

In view of Theorem 14.31 the following definition is justified. We call a hy- 
pothesis testing problem finite if f l4.17l) is fulfilled for all 6 G M and c > 0. 
For hypothesis testing problems which are not finite, we do not have any 
other recommendation than minimization of the Lagrange multiplier function 
Lj^{ip;b,c), for some 6 G M and c > 0, in the class of truncated stopping 
rules using Corollary 14. 1[ For finite problems, we may hope to find optimal 
non-truncated stopping rules using Theorem 14.21 (see Section [5] below). 

There is a way to make the sufficient condition of optimality in Theorem 14.21 
more practical, supposing that, additionally to Assumption 2, Assumption 3 
holds. Namely, it can be shown that in this case '^i = {ip : Et^ < 00, Eqt^ < 
00} G ^ satisfies the conditions of Lemma 14.31 Therefore, by Theorem 14. 2[ 
any ip satisfying (14.151) and (I4.16P will be optimal if ^p E ^i. We formalize this 
in the following 

Lemma 4.4 Let us suppose that Assumptions 2 and 3 are satisfied and that 
the hypothesis testing problem is finite. Then 




exp{-6V2a^}, 



inf L(?/^;6,c) > -00 



(4.17) 



for all b gR and c> 0, or 



mi L{ij;b, c) 



= —00 



00 



U c ^1 c ^. 



(4.18) 



N=l 



The proof of Lemma 14.41 is laid down in Appendix. 
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5 Applications to conditional problems 



For any c > and 6 G M let us call a sequential test (■?/', 0) (6, c)-generated if 
the following conditions are fulfilled: 



/i"- almost everywhere on T^, = 1, 2, . . . , and 

/i'^-almost everywhere on S*^, n = 1, 2, . . . , where 

Z„ = min{0,6/o"-/on (5.3) 



K = hm , 

W— >oo 



for n = 1, 2, . . . , being defined recursively, for n = — 1, — 2, . . . , 1, by 

= min{Z„, cr + / K+W/i(a;n.+i)}, (5.4) 

starting from V).()^ = In-, N = 1,2, 

Let us call a (6, c)-generated test (■?/', (p) regular if 

holds. 

The following Theorem is an immediate consequence of Theorems 13.11 13.21 and 

m 



Theorem 5.1 Let the conditions of Theorem \4.S\ be satisfied. Let c > and 



b > be arbitrary constants, and let 0) be any (6, c)- generated regular test, 
such that -0 G ^. 

Then the sequential test {jp, 0) is locally most powerful for testing Hq : 9 = 9q 
vs Hi : 9 > 9q in the following sense. 

For any cj)'), with ip' G such that 

Et^i < Et^, and a (-0', 0') <«(■?/', 0), (5.5) 

it holds 

/?o(^,0)>/3o(^',0')- (5.6) 
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The inequality in Ii5. 6\) is strict if at least one of the inequalities in Ii5. 5\) is 
strict. 

If there are equalities in all of the inequalities in / (5. 5\) and / (5. 6\) . then {ip', 0') 
is a {b,c)- generated regular test as well. 

Remark 5.1 Under the conditions of Theorem \5.1\ ifiip, <P) is a {b, c)-generated 
regular test with b < 0, and ip & ^ , then it is locally most powerful in the class 
of all sequential tests of the (exact) size a{ip,(f)) (with an equality instead of 
the second inequality in / (5. 5\) . see Remark lSJ]) . 

Similarly, if, under the same conditions, if {il^,(l>) is {b,c)- generated regular 
test with 6 = 0, and ip & ^ , then it is is locally most powerful in the sense 
that for any {ip', cp'), with ip' G ^ , such that 

it holds 

irrespective of the corresponding type I error probabilities, with the respective 
modification of Theorem \5.1\ 

It is interesting to note that if {ip, (p) is (6, c)-generated regular test with 6 < 0, 
then the test {ip, (p), where, by definition, (p = (1— 0i, 1—02, • • • is locally most 
powerful, in the sense of Theorem 15.11 for testing Hq : 6 = Oq vs Hi : 6 < 6q. 
To make this formal, we need some additional results. 

Let for any 6 G M and c > 

L(^) = L{^; b, c) = inf (cEr^ + ba{^, 0) + /3o(V', <P)), 
<p 

and LnHj] b,c) = L(ip^] b,c), where ^p^ = (V'l, . . .,ipN-i, 1, • • • )• 
Theorem 5.2 Suppose that Assumption 2 is fulfilled. 
Let c > and 6 G M 6e arbitrary constants. 
Let W be some class of tests such that 

oo 
Af=l 

and such that LN{jp',b,c) L{ip;b,c) and Ln{iP; —b,c) L{ip; —b,c) , as 
N oo, for all ip e . 
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Then for a stopping rule ifj G ^ 



if and only if 



L{ilj]b,c) = ijif L{ip';b,c) 



L{iIj; -b, c) = ini L{'4)'- -b, c). 



The proof of Theorem 15.21 can be found in Appendix. 

Using Theorem 13.11 and Theorem 13. 2[ we get from Theorem 15.21 the following 



Theorem 5.3 Let the conditions of Theorem \5.2\ be satisfied with some c > 
and b < 0. Let {ip, (p) be any (6, c) -generated regular test, such that ip & and 
let the problem of testing Hq : 6 = 6q vs Hi : 6 > 6q be finite. 

Then the sequential test {tp, 0) is locally most powerful for testing Hq : 6 = Oq 
vs Hi : 9 < 9q in the following sense. 



For any {i/j', 0'), with ip' G such that 

Er^f < Et^ and a{ip',(j)') < a{ip, 

it holds 



(5.7) 



(5.^ 



The inequality in ( f5. 8\} is strict if at least one of the inequalities in ( [5. 7p is 
strict. 



If there are equalities in all of the inequalities in ( [5. 7| ) and ( 15. gj) . then {tp', 0') 
is a regular {b,c)- generated test as well. 



In the rest of this section, we will apply the r esults of Th eorems 15.11 and 
l5.3l to the ca se of i . i.d. ob servations considered in iBerkI (Il975l ). Obviously, the 
conditions of lBerkI (119751 ) imply that our Assumptions 1 to 3 are fulfilled, thus, 
we can make use of all our results above. In this case fg = fg{xi, . . . , x„) = 
n"=i fei^i), where fe is the marginal density with respect to /i, and 



/o (-^1) • • • 5 -^n) ~ ife (-^i) • • • 5 ^n))e 



0=00 



As in iBerkI ( 1975 ). we are using Et^ = Eg^r^ in the conditional minimization 
problems. 



Let us see first, how the structure of (b, c)-generated tests transforms in this 
case (see (El - CT ). 
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It is immediate that = min{0, b — Zn}fQ, where 



j2 ife{xi)yg\e=eo 



i=l 



(we use here the fact that fQ=0 //"-almost everywhere on {/^ = 0}, which 
easily follows from (12. ip ). The definition of z„ in case feoi^i) = does not 
matter, because in this case foi^i, . . . , Xn) = IlILi fdoi^i) — 0- 

Let the i-th summand on the right-hand side of (15. 9p be denoted as = r{xi). 

Let us define g{z) = min{0, —z}, z eM. Let further p^iz) = g{z), z eM, and 
for any n = 1,2,..., recursively, 

p^(z) = min{^(2;), c + / p^^-^z + r(x))/e„(x)d/x(a;)}, (5.10) 



z EK. 

It is easy to see, by induction, that = p^~"-{zn — &)/o , for any n = 
N, N — 1, . . .1, and for any = 1, 2, .... It is also easy to see, by induction, 
that p^{z) > p^~^^{z) for any 2; G M and for any n = 0, 1, ... . Thus, there 
exists Pc{z) = lim^^oo Pc (-2); -2^ £ IR- Below, we will prove that Pc{z) is finite 
for any 2 G M. 

Therefore, 14 = limiv^oo = hmAr_,oo ""(^n - &)/o" = Pcizn - b)f^. In 
particular, Vi = pc(^i - 6)/o = pdn - b)fg,^{xi), thus, 

Ro= Vi{xi)dp{xi) = / pc(r(x) -b)f0^{x)dp{x). 



Further, passing to the limit in (I5.10p . as n — > cxo, we have 

Pc{z) = min{5((z),c+ / pc{z + r{x))feQ{x)dp{x)}, (5.11) 



The inequality /„ < c/^ + / Vn+idp{xn+i) in (15.11) is equivalent now to 

Pc{zn -b) <c + / pc{zn - & + r{x)) fe^{x)dp{x) 



on {/q > 0}. Respectively, the inequality 6/q < fQ in (15. 2p is equivalent to 

b < Zn on {/o" > 0}. 

It follows that a sequential test (■?/', (p) is (6, c)-generated if and only if 
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hg{z„-b)<c+J p,{zn-b+r{x))fegix)dtiix)} < V^n < ^ {g{z„-b)<c+ J pc{z„-b+r{x))fg^{x)dtiix)} 

(5.12) 

/i"'-almost everywhere onT^n{/Q > 0}, n = 1,2,..., and 

I{b<z„} < 4>n < I{b<z„} 

/i"-almost everywhere on (1 {/q > 0}, n = 1,2,.... 
Respectively, a (6, c)-generated test (■?/', 0) is regular if 

Jtt{p,{zr,-b)-g{zr,-b))f^dfi^^O, n^oo. (5.13) 

The plan of the rest of this section is as follows. Let 

hc{z) = / pc{z + r{x))fgg{x)dfi{x) 



(see 15. 111) . Then, if c + hc{0) < 0, it can be shown that there exist Ac < and 
Bc> such that 

g{z) = c + hc{z) 

for z = Ac and z = Be, and that the inequality g{z) > c + hc{z) is equivalent 
toze {Ac, Be). 

Thus, it will follow that a test {ip, (p) is (6, c)-generated (supposing that c + 
/ic(0) < 0) if and only if 

I{zr,^[b+A,,b+B,]} < V'n < /{2„^(b+A„6+Bc)} (5-14) 

/i"-almost everywhere onT^flj/o > 0}, n = 1,2,..., and 

I{z^>b} <(t)n<I{z^>b} (5.15) 
/i"-almost everywhere on S^nj/^ > 0}, n = 1,2,.... 

If c + /ic(0) > 0, it will follow that a test {tfj, 0) is (6, c)-generated if and only 
if V'n = 1 /i^-almost everywhere on fl {/q > 0}, n = 1, 2, . . . , and (15.151) is 
satisfied /i"-almost everywhere on 5*^ fl {/q > 0}, n = 1, 2, . . . . 

Therefore, in this particular case from Theorem 15.11 we will have 



Theorem 5.4 Let Assumptions 1-4 of Berk (197 A) he fulfilled. Let c > 



and b > be any constants, and let {4',4>) be any {b,c)- generated test. 

Then Eqt^ < oo, and the sequential test {ip, 0) is locally most powerful for 
testing Hq : 9 = Oq vs Hi : 9 > 9q in the following sense. For any {ip', 0') such 
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that 
it holds 



Eqt^' < Eqt^, and aijp' .(p') < a{ip, 

/3o(V^,0)>/3o(V'',0')- 



(5.16) 
(5.17) 



The inequality in ( [5. iTp is strict if at least one of the inequalities in ^5.16\) is 
strict. 

If there are equalities in all of the inequalities in Ii5.16\) and (5.11), then {tp', 0') 
is a {h,c)- generated test as well. 

The proof of Theorem 15.41 can be found in Appendix. 

Analogously, from Theorem 15.31 we obtain 

Theorem 5.5 Let Assumptions 1 - 4 of Berk (197 A) he fulfilled. Let c > 
and b < be arbitrary constants, and let {ip,4>) be any {b,c)- generated test. 

Then Eqt^ < oo, and the sequential test {il',4') is locally most powerful for 
testing Hq : 9 = 9q vs Hi : 9 < 9q in the following sense. For any {ip', 0') such 
that 

EoT^f < Eqt^, and a{il)\(j)') < a{i),(j)), (5.18) 

it holds 

/3o(^,0)>/3o(^',0')- (5.19) 

The inequality in Ii5.19\) is strict if at least one of the inequalities in Ii5.18\) is 
strict. 

If there are equalities in all of the inequalities in Ii5.18\) and i\5.iy\) . then [tp', 0') 
is a {b,c)- generated test as well. 

Remark 5.2 It can be s hown (very much like in the proof of Theorem 6 in 
Novikoi (MM), see also for the non-randomized case) that for 



any — oo < A < B < oo any sequential test 0) with 

I{z„^lA,B]} <i^n< I{z„<^{A,B)} 

and 

n = 1,2, is {b, c)-generated for some c > and b G 



(5.20) 
(5.21) 



Roten ( 199^) (see Remark i) on page 182) notes that, generally speaking. 



test of type h5.20) - [5.21\) is not locally most powerful (in the sense of our 
Theorem \5.4\ ) and gives an example of a test {il',4>) of type i\5.20\) - f5.21\) . for 
which there exists another test 0') such that Eqt^ = Eqt^i = k"^, and 
a(^',0') = 0.5 < a(0,V) = 0.8 and /3(V'', 0') = k > /?(0,^) = 0.8A;, where 
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k is any natural number. It follows from Theorem \5.4\ that the only way this 
can happen is that {'ip,4') is {h,c)- generated with b < 0. Thus, it follows from 
Theorem 15.51 that {ip, 0) is locally most powerful for testing = Oq vs 6 < 6q 
at level a{ip, 0) = 1 — «('0, 4>) = 0.2 of significance. 

It is interesting to note that {ip'^cf)') in his example is {b,c)-generated with 
6 = 0, so it is locally most powerful among all sequential tests with the same, 
or lesser, average sample number, irrespective of their a-level (see Remark 

Remark 5.3 It is easy to see that if the distribution of r{Xi) is symmetric 
under Hq (as, for example, in the case of normal family ^(^,(T^), ^ G M, 
(T^ > Oj, then Ac = —B^, i.e. the continuation region of any {b,c)- generated 
test is symmetric with respect to b. In such a case, it follows from Theorems 
5.4 and \5.5\ that any test {ip,4') with 



I{z,^^[b-Bc,b+Bc]} < < I{z,,^{b-Bc,b+Bc)}^ 72 = 1, 2, . . . 

is locally most powerful for testing Hq : 9 = 9q vs Hi : 9 > 9o if b > 
and (pn = I{Zn > & + Bc\, n = 1,2, ... , and it is most powerful for testing 

Hq : 9 = 9o vs Hi : 9 < 9o if b < and 0„ = I{Zn < b - Be}, n = 1,2, 

In both cases the optimality is in the class of all tests with the type I error 
probability and the average sample number not exceeding the corresponding 
values for {4',4>). 

In the case ofb = 0, both tests are locally most powerful, for the corresponding 
pair of hypotheses, in the class of all sequential tests whose average sample 
number does not exceed that of {ip, (p). 



6 Appendix 

6. 1 Proof of Theorem 



The proof is very close to the proof of Theorem 2.2 in iNovikovl (l2009bl ). 



First, the following; lem ma can be proved in exactly the same way as Lemma 



5.1 in lNovikovl fl2009bf ) 



Lemma 6.1 Let, on a space with a a-finite measure fi, Fi,F2 be some fi- 
integrable functions and some measurable function, such that 

< Mx) < 1. 
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Then 

' {(f){x)Fi{x) + (1 - (t){x))F2{x))dn{x) > I mm{Fi(x), F2{x)}dn{x) 
with an equality if and only if 

l'{Fi{x)<F2{x)} < 4>{x) < I{Fi(x)<F2{x)} 

fi-almost everywhere. 

After this simple lemma, we can start with the proof of Theorem 13.21 
Let us give to the left-hand side of (13.91) the form 



oo 



n=l 



ba{^, 0) - f3o{^, 0) = E / 4Ubfo - fo)d^^''■ (6-1) 



Applying Lemma [6TT] (with F2 = 0) to each summand in (16.11) we immediately 
have: 

00 „ 

ba{^, 0) - $o{^, ct>)>Y. ht min{0, hf^ - f,^}dfi''. (6.2) 

n=l 



Let us note that the right-hand side of (16.21) is finite: it follows from (16. ip by 
substituting 0^ = /|^^„_y„^Q| for 0„, n = 1, 2, . . . in (16.11) . 

Thus, there is an equality in (16. 2p if and only if each summand on the right- 
hand side of (16. ip equals to the respective summand on the right-hand side 
of (16. 2p . And by Lemma 16.11 this happens if and only if 0„ satisfies (I3.10p 
/^"-almost everywhere on S^, for any n = 1,2, . . . . 



6.2 Proof of Theorem\4.1 



Using Lemma 16.11 instead of L emma 5.1 of iNovikovl (j2009bl ) in the proof of 



Lemma 3.1 of iNovikovl (j2009bl ) we get the following lemma, which takes over 



the major part of the proof of Theorem 14.11 
Lemma 6.2 Let k be any integer non-negative number, and let 

Vk+l = Vk+l{xi,X2, Xk+l) 

be any fi^~^^-integrable function. Then 

k 

E / sticnr + Qdfi'' + J tti {c{k + l)f'^' + Vk+i) dfi 

n=l 



fc+1 
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with 



E / 4{cnr + Ddfi"" + Jtt {ckf + Vk) dfi', 

n=l 



where, by definition, 



Vk+id^{xk+i) = / Vk+i{xi,...,Xk+i)d^,{xk+i)- 



There is an equality in lid. 3\) if and only if 



(6.3) 



{lk<cf''+J Vk+ld^l{xk+l)} 



fi^ -almost everywhere onTji = {{xi, . . . ,Xk) :tj^{xi,... ,Xk~i) > 0}. 



To start with the proof of Theorem 14.11 let us first note that, by definition, 
Qjv(^) = Ln{iP), and, by Lemma 16^ 



Also from Lemma [6.21 we easily get that 



(6.4) 



for alln = A^-1,A^-2,...,1. 



Thus, for any k = 1, . . . , N 



(6.5) 



Obviously, there is an equality in (16. 5p if and only if there are equalities in all 
the inequalities in (16.41) . for all n = k, k + 1, . . . , N — 1. In turn, this happens, 
by the same Lemma [6.21 if and only if (14.51) is satisfied yu"-almost everywhere 



on for all n = fc, + 1, . . . , - 1. 



6. 3 Proof of Theorem \4.2\ 



The proof is very close to the pr o of of T heorem 3.2 in iNovikovl (j2009bl ). The 
same method is used in iNovikovl (l2009al ) for multiple hypothesis testing. 



Let ^/^ G ^ be any stopping rule. By Lemma 14.21 for any fixed n > 1 
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In particular, 

L{i;)>Q,{i;) = c + Ro. 



Passing the the hmit in (16 ■4p . as ^ cxd, we have 

Qn+lW > QnW, (6.6) 

for any n = 1, 2, . . . , thus, 

L{^p) > Qn+lW > QnW > c + Ro, (6.7) 

for any n = 1, 2, . . . . Supposing (14.141) . we have, by virtue of Lemma [4.31 that 
there are equahties in all the inequalities in (16.71) . In particular, there is an 
equality in (16.61) . for any n = 1,2, . . . . 

Because, by the condition of Theorem 14.21 Rq > — oo, the integrals on both 
sides of (16.61) are finite. Applying Lemma 16.21 we see that (14.151) is fulfilled 
/i'^-almost everywhere on T^, for any n = 1,2,.... 

(I4.16P now follows because 

QnW = Lnit/J) + J 4{Vn - /n)rf/i" = C + Ro (6.8) 

for any n = 1, 2, . . . , and lim„^oo -Z^n(V') = L{ip) = c + Rohj the conditions of 
the Theorem. 

The "only if '-part of Theorem 14.21 is proved. 

Let now ip satisfy (I4.15P /i"-almost everywhere on T^, for any n = 1,2, .. . 
and let (14.161) hold for this ip. 

It follows from Lemma [6.21 that 

QnW = Qn~lW = --- = Ql{^)=C + Ro 

for any n = 1, 2, .... It follows from (16.80 and (I4.16P that lim„^oo Ln{ip) = c + 
Rq. But ip E^, so limn^oo Lni^p) = L{ip) , thus L{ip) = c + Rq = inf^/g<y L ('?/''). 

6.4 Proof of Theorem \4 ■ 3\ 

Let us first note that that if inf^g^ L{tp; b, c) > —00 for some 6 G M and c > 0, 
then inf^gc^ L{iIj; b', d) > —00 for all 6' e M and c' > c. Indeed, if for any k > 
—00 there exists (■?/', 0) with ip E ^, such that c' Er^ + b' a{ip, 0) —Po{ip, 4>) < 
then 

c'Et^ - (5q{iIj, (p) < k- min{0, b'}. 
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and 

cEt^ + ha{il), 0) - /3o(V^, 0) < cEr^ - /9o(V', 0) + max{0, h} 
< c'Et^ - i3o{ip, 0) + max{0, b} < k - min{0, b'} + max{0, 6}, 
so inf^g^ L^ip; b, c) = — oo. 

Thus, we can know that inf^g^^ L^ip; b, c) > — oo, for aU 6 G M, with just 
checking that 

h{c) = inf L(-0;O,c) > — oo. 

Let us note that h : (0, oo) i— > Mu {— oo} is a concave function, as an infimum 
of a family of concave (hnear) functions. In addition, it is obviously non- 
decreasing. It easily follows from this, that either h{c) > — oo for all c > or 
h{c) = — oo for all c > 0. 



6. 5 Proof of Lemma 4 ■ 4 



The first inclusion in f l4.18l) is obvious. 

Let -0 G be any stopping rule. Let us show that L^{ip) L{ip) as N ^ oo. 
First, let us note that L{iIj) is finite. This is because, on the one hand, by 
Lemma |4.3[ L{iIj) > c + Rq > — oo. On the other hand, by (13. lip . L{iIj) < 
Er^ < oo. 

Now, by definition, 

L{^P)-LNi^) = E / stinf^ + ln)dfi''- I t%N f"" d^i"" - j t%lNdfi'' (6.9) 

n=N 

The first summand on the right-hand side of (16. 9p tends to 0, as ^ oo, 
because it is a tail of a converging series {L{ip)). 

The second summand on the right-hand side of (16. 9p tends to as well, because 

J t^Nf'd^i^ = NEt% = NP{t^ > iV) ^ 0, 
as — i> oo, since Et^ < oo. 

It remains to show that the third summand on the right-hand side of (16.90 
goes to as well. 

To start with, let us note that 



tthdfi'' = E,T^ (min {O, b - f^lf^]) 
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(it is easy to see, using (12. ip . that /o = /i"-almost everywhere on {/q = 0}). 
Therefore, using Schwarz' inequahty we have 

(I tthd^'^y < Eo{t%fE, (min {o, h - / f^]f . (6.10) 

Because Eo{t%f < Eot% = Pq{t^ > N) and 

^o(min {O, b - /o^//o^})^ < E,{b - / f^f 

<2h'' + 2E,{f^/f^f<2h' + 2^N 
for N > Nq (by Assumption 3), we have from fl6.10p now that 

ttflNdfi'^y < 2Po{t^ > N){b^ + 7iV) ^ 
as oo, because Eqt^ < oo. 

6. 6 Proof of Theorem \5.2\ 

Let G ^ be such that 

L{i;;-b,c)= mim;-b,c). (6.11) 

By Theorem 14.21 it folfows from (16. lip that is defined by means of the 
functions = min{0, —bf^ + f^} and Vn = hmAr^oo , n = 1, 2, . . . , where 

= min{[„,c/" + I \/^,d/i(x„+i)} 

n = AT - 1, AT - 2, . . . , 1, being = In- 
Let us note that 

L = min{0, 6/o" - f^ ' + /o = In - bf^ + f^ (6.12) 
Using this fact, it is easy to see that for any A^ = 1,2,... 

Vf = Vf -&/o +/o, (6.13) 
/i "-almost everywhere for any n = A^, A^ — 1,...,1. 

Indeed, (I6.13P is satisfied for n = A^ be virtue of (I6.12p . Let us suppose now 
that (I6.13P is satisfied for some n = k. Then 

Vl, = min{4_i,c/'=-i + I Vf f//i(x,)} 
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= min{4_i, cf^' + I (Vf - bf^ + f^)dfi{xk)} 

= min{4_i, cf-' + J Vf - bfl;-' + f^'}, 

/i''"^-almost everywhere, because J fQ{xi, . . . ,Xk)dfi{xk) = fo{ Xi, . . . , Xk—i J 
and f fQ~^{xi, . . . , Xk)d^{xk) = /g . . . , x^-i) /i'^" ^-almost everywhere 
(the latter easily follows from (12.11) ). Now, it follows from (16.121) that (I6.13P is 
also satisfied for n = k — 1, /i'^~^-almost everywhere. 

Now, passing to the limit, as — > oo, in (I6.13p . we have 

/i^-almost everywhere. 
Because, by Theorem 14.21 

hl^<cf"+J Vn + ldll{Xn + l)} ^ hln<cf" + J Vn + ldfl{x„ + l)} 

/^"-almost everywhere on T^, it follows from (16.121) and (I6.14p that 

-^{«n<c/" + / V„+ldMl^„ + l)} < ^ < hln<cr+J y„ + ldMx„ + i)}' (6.15) 

/i"-almost everywhere on T^, n = 1, 2, ... . 
In addition, 

/ ttiV^ - Ddfi"" = J tt{V„. - Qdfi^ ^ 0, (6.16) 

as n ^ oo. 

Let us show now that the problem of testing Hq : 6 = 6q vs Hi : 6 > Oq is 
finite. 

It follows from (16.111) that 

cEt^ - ba{ip, 0) + /?o(V^, 0) > A; > -oo (6.17) 

for all G ^ and for all decision rules 0. Let now 0„ = 1 — 0„, = 1, 2, . . . . 
Then ai^P, 0) = En=i EoS^n = 1 - E^Li E^st^^, and 

OO „ OO „ oo „ 

/^O(^,0) = E y fosUnd^^- = Y.j fostdfi" - E y fost^nd^i-. 
n=l n=l n=l 

It follows from (16.170 now that 

oo „ 

cEt^ + baii:, 0) - Poii^, ^) + T. fo^dfi'" >k + b. (6.18) 

n=l 
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Let (pn = 1. Then, by Assumption 2, 

Y: j f^st^ndli-] =Y.j fostdfi"" < 0, 



=eo 



n=l • 



because / fe^t'i'nd^'^ = Peij^ < oo) = 1 for 6* = 6q, and is less than or 
equal to 1 for any other 9. We have from ( I6.18P that 

cEt^ + ha{il}, (j)) - /3o(^/', (f)) > k + h, 

and therefore 

inf 6, c) > A; + 6 > -oo. (6.19) 

It follows from flO^ . flOB]) and fICTD . by Theorem S^l that 

L(V^;&,c) = infL(V'';6,c). (6.20) 

By analogy, it can be shown that if %ij satisfies fl6.20p . then it satisfies (16.111) 
as well. 



6.7 Proof of Theorem 5.4 



The essential part of the proof is the use of Theorem 15. II with ^ = ^i, where 
^1 = {"^ • Eqt^ < oo} (see Lemma [4.41 due to which the conditions of Lemma 
14.31 are satisfied). 

For the proof, we need some properties of the functions Pc{z), n = 1,2, ... , 
and p{z), zeR (see flETUD and ([5HD). 

Lemma 6.3 Every pj? : M i-^ M zs non-positive, concave, non-increasing, such 
that p^{z) + z is non- decreasing with respect to z, and such that 



lim (/)"(z) + z) = and lim p"(;z) = 0, 

n = l,2,.... 

Proof. It is obvious that Pc(-^) — di^) — niin{0, —z} has all the claimed in 
Lemma 16.31 properties. If for some A; > p^' has all these properties, let us 
show that p^+^ does so as well. 

By definition, 

p^^(z) = mm{g{z),c+ f p'^iz + r{x))fe,{x)dp{x)} (6.21) 
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Obviously, pj"*"^ is non-positive, concave and non- decreasing. Because of this, 
the integral on the right-hand side of fl6.2ip . by virtue of Lebesgue's monotone 
convergence theorem, goes to as z — — oo. Thus, p^'^^{z) — as 2; — >• —00. 

We have further that 

+ z = min{min{z, 0}, c + J {{z + r{x)) + p\{z + r(x)))/e„(a;)rf/i(x)}, 

(6.22) 

so it is non- decreasing with respect to 2;, and, by the monotone convergence 
theorem, goes to 0, as z ^ 00. ■ 

It easily follows from Lemma 16.31 that Pc(^) = lini„^oo (^) possesses the 
same properties as p". 

Lemma 6.4 The junction p^ : M 1-^ M «s non-positive, concave, non-increasing, 
such that Pc{z) + z is non- decreasing with respect to z, and such that 

lim (pc(-2) + = and lim Pc{z) = 0. (6.23) 

Proof. The only non-trivial thing to prove is fl6.23p - other properties follow 
from the point-wise convergence. To prove it, we start from 

Pciz) = mm{g{z),c + J p^z + r{x))f0o{x)dp{x)}, (6.24) 

which follows from fl6.2ip by the monotone convergence theorem, and 

Pciz) + z = min{min{2;,0},c+ J {{z+r{x))+ pc{z+r{x)))fe^Xx)dp{x)}, (6.25) 

which follows from ( ]6.22p in the same way. 

Because Pc{z) is non-increasing, \imz-,-oo Pc{z) = Oi, so, letting z —00 in 
f l6.24p . we have that ai = min{0,c + ai}, thus ai = 0. Similarly, there exists 
lim2^oo(Pc(-2) + z) = 02. Passing to the limit, as z — > 00, in (16.251) we have 
a2 = min{0, c + 02}, thus 02 = 0. ■ 

It easily follows from Lemma [6.41 that g{z) — Pc{z) is a non-negative function 
tending to as z — — 00 or z — 00, and such that 

g{z)- p,{z)<g{Q)- p,{Q) = -p,{Q) for any 2; G M. (6.26) 

Let hc{z) = J pc{z + r{x))fgfX^)dp{x) (see (16.241) ). It follows from the Jensen 
inequality that hc{z) < Pc{z), 2; G M. In addition, obviously, hc{z) ^ as 
z — > —00 and hc{z) + 2 — as 2; — 00. Thus, g{z) — hc{z) is also a non- 
negative function tending to as 2; —00 or 2; — 00 with a maximum 
reached at 2; = 0. In addition, it is easy to see that g{z) — hc{z) is convex as 
a function on (—00, 0], and that it is convex as a function on [0, 00). 
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Therefore, for any < c < —hc{0) there are Ac < and Bc> such that 

g{Ac) = c + hc{Ac) and g{Bc) = c + KW, (6.27) 

and such that g{z) < c + hc{z) for z < Ac or z > Be, and g{z) > c + hc{z) for 
z G (Ac, -Be)- Because of this, fl5.12p is equivalent to (15.141) . On the other hand, 
if c > —hc{0), then c + hc{z) > g{z) for all 2; G M. Thus, (I5.12p is equivalent 
to ipn = ^ in this case. 

We have just proved that any (6, c)-generated stopping rule ip is as described 
immediately before Theorem 15.41 

Let us show now that for any (6, c)-generated stoping rule ip it holds Eqt^ < 00 
(that is, G ^1). We have 

Po{r^>n) = Eott<Peoitt>0) 

< Peoizk e {b + Ac,b + Be), for anyfc = 1 2,. . n - 1). 
Now, the finiteness of Eqt^ follows by arguments of Berk ( 19751 ). p. 376. 



It is easy to see now that any (6, c)-generated stopping rule ip is regular, i.e. 
that (I5.13P holds true. This is due to (I6.26p . because 



< / tt{g{zn ~h)- pc{z^ - h))f^di,- < -pM I ttf^df,"^ 



as n — * 00. 



Thus, all the conditions of Theorem 15.11 are satisfied, so the assertion of The- 
orem 15.41 follows. 
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